Quantum magnetism of ultra-cold fermion systems with the symplectic symmetry 
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We numerically study quantum magnetism of ultra-cold alkali and alkaline-earth fermion systems 
with large hyperfine spin F = ^, which are characterized by a generic Sp{N) symmetry with A'' = 4. 
The methods of exact diagonalization (ED) and density-matrix-renormalization-group are employed 
for the large size one-dimensional (ID) systems, and ED is applied to a two-dimensional (2D) square 
lattice on small sizes. We focus on the magnetic exchange models in the Mott-insulating state at 
quarter-filling. Both ID and 2D systems exhibit rich phase diagrams depending on the ratio between 
the spin exchanges Jo and J2 in the bond spin singlet and quintet channels, respectively. In ID, the 
ground states exhibit a long-range-ordered dimerization with a finite spin gap at J0/J2 > 1, and a 
gapless spin liquid state at J0/J2 < 1, respectively. In the former and latter cases, the correlation 
functions exhibit the two-site and four-site periodicities, respectively. In 2D, various spin correlation 
functions are calculated up to the size of 4 x 4. The Neel-type spin correlation dominates at large 
values of J0/J2, while a 2 x 2 plaquette correlation is prominent at small values of this ratio. Between 
them, a columnar spin-Peierls dimerization correlation peaks. We infer the competitions among the 
plaquette ordering, the dimer ordering, and the Neel ordering in the 2D system. 

PACS numbers: 71.10.Fd, 75.10.Jm, 71.10.Pm, 75.40.Mg 



I. INTRODUCTION 

The recent experimental progress on the ultracold 
Fermi gases with large hyperfine spin provides an exciting 
opportunity to investigate novel physical properties^""*. 
In usual condensed matter systems, large spin is not 
considered particularly interesting because large values 
of spin suppress quantum fluctuations. For example, in 
transition metal oxides, a large spin on each cation site 
is usually referred as an effective spin S composed of 25* 
electrons by Hund's rule. The spin exchange between two 
cation sites at the leading order of the perturbation the- 
ory only involves swapping one pair of electrons regard- 
less of how large S is. The variation of Sz is only ±1, 
thus increasing S reduces quantum fluctuations known as 
the 1/S-eSect. In contrast, in ultracold fermion systems, 
the situation is dramatically different, in which large hy- 
perfine spin enhances quantum fluctuations. Each atom 
moves as a whole object carrying a large hyperfine spin. 
Exchanging cold fermions can completely flip the entire 
hyperfine-spin configuration, and thus enhances quantum 
fluctuations. In other words, large spin physics in solid 
state systems is usually in the large S*- limit, while in cold 
atom systems it is in the large N limit where N is the 
number of fermion components 2F + 1~. We follow the 
convention in atomic physics to use F to denote the hy- 
perfine spin of the atom. 

Ultracold fermion systems with large hyperfine spins 
have aroused a great deal of theoretical interests. Early 
work studied the rich structures of the Fermi liquid 
theory^ and the Cooper pairing structures^. Consider- 
able progress has been made in the simplest large hy- 
perfine spin systems with ^ = §, whose possible can- 
didate atoms are "2Cs, ^Be, ^^^Ba, ^^"^Ba and ^oiRg. 
These include both alkaline-earth-like atoms with zero 



electron spin due to the fully filled electron shells, and 
non-alkaline-earth atoms with nonzero electron spins^iii^. 
In both cases, a generic S'p(4), or, isomorphically, 5*0(5) 
symmetry is proved without fine tuning. Such a high 
symmetry without fine-tuning is rare in both condensed 
matter and cold atom systems. It brings hidden de- 
generacy in the collective modes in the Fermi liquid 
theory^, fruitful patterns of quantum magnet isrrt^i^ ' ^ ° 1 ^ ^ 
and Cooper pairing with large internal spin degrees of 
freedon>2,ii2 Further investigations in the community 
include the study of Mott insulating states^^rJ^, Beth- 
ansatz solutioni2,i22, Kondo effect2i, and the 4- fermion 
quartetting superfluidity22i"— . Recently, SU{N) models 
have been proposed for the alkaline-earth fermion atoms 
since their interactions are insensitive to their nuclear 
spins. It is a special case of the Sp{N) model by fur- 
ther tuning interaction parameters of spin singlet and 
multiplet channels to be the same^^"^^. The possible fer- 
romagnetic states have also been studied for the SU{6) 
symmetric system of ^''^^Yb^^. A detailed summary is 
presented in a review Ref. Mand a non-technique intro- 
duction is published at Ref. [3] by one of the authors. In 
a different context of heavy fermion systems, the effects 
of sympletic symmetr y to q uantum magnetism have also 
been studied in Ref. |29ll3(j |. 

One dimensional (ID) systems are important for the 
study of strong correlation physics because of the dom- 
inant interaction effects. Furthermore, controllable ana- 
lytical and numeric methods are available. In Ref. fl]|, 
one of the authors performed the bosonization method to 
study competing phases in ID systems with F = |, in- 
cluding the gapless Luttinger liquid, spin gapped Luther- 
Emery liquid with Cooper pairing instability, and 4- 
fermion quartetting superfiuid at incommensurate fill- 
ings. At commensurate fillings with strong repulsive in- 
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teractions, a charge gap opens and the systems become 
Mott-insulating. The gapless Luttinger Uquid phase 
becomes a gapless spin Uquid phase at quarter-filhng 
and dimerized at half-filhng, respectively^. The Luther- 
Emery phase becomes the gapped S'p(4) dimer phase at 
quarter-filling and the on-site singlet phase at half-filling, 
respectively^. 

On the other hand, the two dimensional (2D) S'p(4) 
Heisenberg model is still far away from clear understand- 
ing. Such a system can bring fruitful intriguing features 
of quantum magnetism which do not exhibit in usual 
solid state systems. For example, in the special case 
of the SU{4:) symmetry, four particles are required to 
form an S'J7(4) singlet, thus its quantum magnetism is 
characterized by the 4-site correlation beyond two sites. 
Such a state is the analogy to the three-quark color sin- 
glet baryon state in quantum chromodynamics. It is 
also the magnetism counterpart of the 4-fermion quartet- 
ting instability with attractive interactions*. Recently a 
magnetic phase diagram in a spatially anisotropic square 
lattice of the Sp{4:) quantum magnetism is provided by 
means of large- field-theoretical approach"^^. A phase 
transition between the long-range Neel order state and 
the disordered valence bond solid phase is discovered by 
the perturbative renormalization group equations. How- 
ever, the model on an isotropic square lattice is still un- 
explored. In particular, quantum Monte Carlo methods 
for this model suffer the notorious sign problem except 
in the special case where only the singlet bond exchange 
exists. 

In this article, we present a systematic numerical study 
for the Sp{4:) Heisenberg model at quarter filling in both 
ID systems with large sizes and 2D systems up to 4 x 4 by 
means of exact diagonalization techniques and the den- 
sity matrix renormalization group (DMRG)'^^''^^. In ID, 
we numerically show that the system exhibits two com- 
peting quantum phases: a long-range-ordered gapped 
dimer phase when the exchange interaction in the bond 
singlet channel (Jo) dominates over that in the quin- 
tet channel (J2), and a gapless spin liquid phase other- 
wise. The 5^(4) spin correlation functions are calculated, 
which shows that in the dimer phase the correlations have 
the 2-site periodicity, whereas in the gapless spin liquid 
phase they have the 4-sites periodicity. In 2D, our nu- 
merical simulations for small sizes indicate three different 
dominant correlations depending on the values of 
We infer three competing phases: the Neel ordering, the 
plaquette ordering, and another possible phase of colum- 
nar dimer ordering, in the thermodynamic limit. 

The rest of this article is organized as follows. In 
Sec. ini we introduce the Hamiltonian of spin-| fermions 
which possesses the rigorous Sp{A) symmetry, and a 
magnetic exchange model in the Mott-insulating state 
at quarter-filling. A self-contained introduction of the 
Sp{4:)/SO{5) algebra is given. Then we separate our 
main discussion into two parts: Sec. IIIII for ID and 
Sec. |IV] for 2D systems. In Sec. IIII Al we study the 
low-energy spectra of a finite size Sp{A) chain with both 



open and periodic boundary conditions. In Sec. IIIIBl the 
DMRG calculation on the spin correlation functions are 
presented to identify the gapped 5^(4) dimer phase and 
the gapless spin-liquid phase. In the second half part, we 
first analyze the 2x2 cluster in Sec. IIV Al and perform 
exact diagonalization on larger sizes to study the low- 
energy spectrum behavior in Sec. IIVBI Then we display 
the calculations of the magnetic structure form factor in 
Sec. IIV C[ the dimer correlation in Sec. IIVDI and the 
plaquette-type correlation in Sec. IIV El We discuss the 
possible existence of the corresponding orderings. Con- 
clusions are made in the last section. At the end of this 
paper, we present a brief and self-contained introduction 
to the representation theory of Lie group in Appendix A 
to C. 



II. MODEL HAMILTONIAN AND THE 
HIDDEN 5*^(4) SYMMETRY 

A. The spin-| Hubbard model 

We start with the generic one-band Hubbard model 
loaded with spin-| fermions. By neglecting long-range 
Coulomb interactions, only onsite interactions are con- 
sidered in the Hubbard model. Due to Pauli's exclusion 
principle, the spin wavefunctions of two onsite fermions 
have to be antisymmetric. The total spin of two onsite 
spin- 1 fermions can only be either singlet {St = 0) or 
quintet (St — 2). We assign an independent interaction 
parameter Uq (singlet) and U2 (quintet), respectively, to 
each channel. The Hamiltonian reads 

{ij),a to- 
i z,m— — 2, . . ,2 

(1) 

where (ij) denotes the nearest neighboring hopping; a 
represents four spin flavors = ±|, ±i; Pq and Pjm 
are the singlet and quintet pairing operators defined 
through Clebsch-Gordon coefficients as 

a/3 

The actual symmetry of Eq. [T] is much larger than 
the SU{2) symmetry: it has a hidden and exact S'p(4), 
or, isomorphically, 50(5) symmetry. The 5*^(4) alge- 
bra can be constructed as follows. For the 4-component 
fermions, there exist 16 bases for the 4x4 Hermitian 
matrices MQ^(a,/3 = ±|,±i). They serve as matrix 
kernels for the bi-linear operators, i.e., ipaM^fjipp, in 
the particle-hole channel. The density and 3-component 
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spin Fx,Fy,Fz operators do not form a complete set. 
The other 12 operators are built up as high rank spin 
tensors, including 5-component spin-quadrupoles and 7- 
component spin-octupoles. The matrix kernels of the 
spin-quadrupole operators are defined as 

- -^{F^Fy + FyF^), r'^^{F,F, + F,F,), 
= l=iF^Fy + FyF^), T^ = iF!-l), 
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(3) 



which anti-commute with each other, and thus form a 
basis of the Dirac-F matrices. The matrix kernels of 3 
spin and 7 spin-octupole operators together are generated 
from the commutation relations among the 5 F-matrices 
as 



pao 



— [F^ F^l 



(l<a,6<5). (4) 
Consequently, these 16 bilinears can be classified as 



«p^/^' — 2 

where n is the density operator; n^s are 5-component 
spin-quadrupole operators; Lab's are 10-component spin 
and spin-octupole operator o"^i^° . Reversely the spin 
SU{2) generators Fx,y,z can be written as F+ — 
y3(-L34 -I- 1^24) - {L12 + iL2h) + i{Li3 + iLss) and 
Fz = L23 + 2L15. 

The 15 operators of Ua and Lab together span the 
SU{A) algebra. Among them, the 10 Lab operators are 
spin tensors with odd ranks, and thus time-reversal (TR) 
odd, while the 5-component na's are TR even. The TR 
odd operators of Lab form a closed sub-algebra of Sp{A). 
The 4-component spin-| fermions form the fundamental 
spinor representation of the Sp{4) group. In contrast, 
the TR even operators of Ua do not form a closed alge- 
bra, but transform as a 5- vector under the 5*^(4) group. 
In other words, S'p(4) is isomorphic to S0{5). But rig- 
orously speaking, the fermion spinor representations of 
Sp{4) are not representations of 50(5). Their relation 
is the same as that between SU{2) and SO{3). Below 
we will use the terms of Sp{4) and SO{5) interchange- 
ably. The SO{5) symmetry of Eq. [T] can be intuitively 
understood as follows. The 4-component fermions are 
equivalent to each other in the kinetic energy term, which 
has an obvious SU (4) symmetry. Interactions break the 
SU{A) symmetry down to 5*0(5). The singlet and quin- 
tet channels form the identity and 5-dimensional vector 
representations for the 50(5) group, respectively, thus 
Eq. [T]is 50(5) invariant without any fine-tuning. 



B. Magnetic exchanges at quarter- filling 

Mott-insulating states appear at commensurate fillings 
with strong repulsive interactions. We focus on the mag- 
netic exchange at quarter filling, i.e., one fermion per 



site. The Heisenberg type exchange model has been con- 
structed in Ref. '7] through the second-order perturba- 
tion theory. For each bond, the exchange energies are 



Jo 



4*1 

Uo 



for the bond spin singlet channel, J2 



At' 

- . . U2 

for the bond spin quintet channel, and Ji — — for 
the bond spin triplet and septet channels, respectively. 
This exchange model can be written in terms of bi-linear, 
bi-quadratic and bi-cubic Heisenberg exchange and the 
Hamiltonian reads as 

where a = — ^(BUq + 23J2), 6 — f^(5Jo + I7J2) and 
c ~ ■^h{JQ + J2) and F^^y^z are usual 4x4 spin operators. 
Eq. |6] can be simplified into a more elegant form with 
the explicitly 50(5) symmetry^ as 



Llpx — 



E{ E 

(ij) l<a<b<5 

3J2 — Jo 



J0 + J2 



Lab{i)Lab[i) 



^na(i)"a(j)}. 



(7) 



a=l 



In the 50(5) language, there are two diagonal operators 
commuting with each other and read as 



ii5 — —{ni + ni — n_i — n_3), 
2 2 2 2 2 ' 

L23 — —(ns —ni +n 1 —n 3). 



(8) 



Corresponding to the spin language, each singlet-site ba- 
sis state can be labeled in terms of these two quantum 
numbers as \Fz) = 1^15,-^^23): I ± §) = I =•= ^^i^) ^^^^ 
I ± i) = I ± ^,T-^}- For an arbitrary many-body state, 
Fif = Fi5{i) and L^f = L2?,{i) are good quantum 
numbers (similar to that = Fz{i) is conserved in 
SU{2) cases) and can be applied to reduce dimensions of 
the Hilbert space in practical numerical calculations. 

There exist two different SU (4) symmetries of Eq. [7] 
in two special cases. At Jq = J2 — J, *-e., Uq = U2, it 
reduces to the SU (4) Heisenberg model with each site in 
the fundamental representation 



-ff = E ■^{Fab{i)Labij) + na{i)na{j)y 



(9) 



(id) 



Below we denote this symmetry as SU{4)a- In this case, 
there is an additional good quantum number 77,4, 



71,4 



1. 

2^ I 



(10) 



This SU{A) model is equivalent to the Kugel-Khomskii 
type model2ii^ and is used to study the physics with in- 
terplay between orbital and spin degree of freedom.—"—. 
On the other hand, at J2 = 0, i.e., ?72 — >■ -l-oo, Eq. [7] has 
another 5C/(4) symmetry in the bipartite lattice, which 
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is denoted SU{4)b below. In this case, we perform the 
particle-hole transformation to one sublattice but leave 
the other sublattice unchanged. The particle-hole trans- 
formation is defined as ipa Ra^i/j'p where R is the 
charge conjugation matrix 

Under this operation, the fundamental representation 
transforms to anti-fundamental representation whose 
5^(4) generators and vectors become L^^ = Lab and 
n'^ = —ria- Thus Eq. [7] can be recast to 

^ = E ^K,{t)Lab{j) + <{t)na{j)), (12) 

which is SU{4:) invariant again. 

These two SU (4) symmetries have very different phys- 
ical properties. In the case of SU{4)a, two sites 
are not enough to form an 5'C/(4) singlet. It at 
least needs four sites to form an SU{4) singlet as 

eQ/375V'i(l)V'jj(2)V'7(3)V'l(4), where eap^yS is the rank-4 
fully antisymmetric tensor. Thus quantum magnetism 
of Eq. [7] at Jo — J2 is characterized by four-site cor- 
relations. The ground state of such a system on a 2D 
square lattice was conjectured to be a plaquette S'C/(4) 
singlet state without magnetic long-ranged ordering. '^^■'^^ 
On the other hand, for the SU{A)b case, two sites can 
form an S'f/(4) singlet as i?a^jVl(l)V'^(2). In the 2D 
square lattice, a long-ranged Neel order is identified by 
quantum Monte Carlo simulations^ and large N limit4i 
The square of the staggered magnetization is numerically 
given as nis ~ 0.091, which is much smaller than that of 
the SU{2) Neel order state. 



III. QUANTUM MAGNETISM IN THE ID 
CHAINS 

We start our discussion on the ID chain. The phase 
diagram of the ID spin-| Hubbard model has been 
studied by one of the author using the method of 
bosonization^iii. At the commensurate quarter-filling 
(one particle per site) with purely repulsive interactions 
{Uq > 0,1/2 > 0), the 4fc/-Umklapp term opens a charge 
gap as Kc < ^. In this case, the physics is captured by 
the exchange model of Eq. [71 It has been found that 
in the regime of J0/J2 > 1 dimerization of spin Perierls 
order is present, whereas it is a gapless spin liquid phase 
at J0/J2 < 1 (see Fig. [T])^^. In the following, we use ex- 
act diagonalization methods and DMRG not only iden- 
tify these two competing phases but also demonstrate the 
ground state profiles and 4-site periodicities in spin-spin 
correlations. 



SU(4), 

SU{4)^ line 

dimerization 




gapless spin liquid 




FIG. 1: Phase diagram of the ID chain in terms of the singlet 
and quintet channel interaction Jo and J2. In this context, 
e is the angle defined hy 6 = tan"^(Jo/J2). The 5'(7(4)a 
type (6 = 45°) denoted by the dot line belongs to the gapless 
spin liquid state whereas SU{A)b along J2 = 0. The phase 
boundary separating the dimerization phase and the gapless 
liquid state is the SI7(4)a line. 



A. Exact diagonalization on low energy spectra 

In this subsection, we apply the exact diagonalization 
technique to study the ID 5*^(4) spin-| chains with near- 
est neighbor exchange interactions described by Eq. [T] 
We only consider the case of the site number — 4m. 
For convenience, we set Jq — \/2sin0 and J2 — \/2cos6'. 
Regardless of 9 and sizes iV, the ground states (GS) only 
exist in the {L\°^,Ll°^) = (0,0) sector and are unique 
with C = 0, where C denotes the Sp{A) Casimir of the 
entire system and is expressed in terms of the 5'p(4) gen- 
erators as 

l<a<6<5 i 

In addition to L\°^ and ^23*, the Casimir C is also a con- 
served quantity in the 5^(4) system, analogous to the 
total spin in SU (2) systems. Each energy eigenstate can 
be labeled by C and further identified the dimension of 
the representation (degeneracy). As shown in the table 
II in the Appendix, while C — 0, the state is an 5*^(4) 
singlet and unique whereas while C > the state is mul- 
tiplet and has degeneracy which is equal to the dimension 
of the associated representation. 

In Fig. [11(a) and (b), the ground state and low excited 
states with 12 sites are presented using open and peri- 
odic boundary conditions, respectively. The GS as vary- 
ing 9 angles is always an Sp{4) singlet, which becomes an 
SU{4) singlet at 6* = 45° (5J7(4)a) and 9 = 90° iSU{4) b) 
for both boundary conditions. For the low energy excited 
states, we first look at the regime of 45° < 6 < 90°, i.e., 
Jo > J2. With open boundary conditions (OBC), the 
lowest excited states (LES) are the 5*^(4) 5-vector states 
with the quadratic Casimir C = 4. The next lowest ex- 
cited states (NLES) are 10-fold degenerate and belong 
to the 10-dimensional (lOJ) 5^(4) adjoint representation 
with C = 6. The LES and NLES merge at both of the 
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e e 

FIG. 2: The exact diagonalization on ID chain with 12 sites 
for (a) open and (b) periodic boundary conditions. The dis- 
persion of the ground state and low excited states, and the 
dimensions d of their corresponding representations of the 
Sp{4:) group are shown. 
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FIG. 3: Exact diagonalization results on the Sp{4) singlet- 
singlet gap with Jo > J2 and periodic boundary conditions ( 
9 = 60° and 75° with = 8, 12 and 16). Finite size scaling 
shows the vanishing of the singlet-singlet gap Asa. 



SU{4:)a [e = 45°) and SU{A)b [9 = 90°) points, and 
become 15-fold degenerate. This is the SU{A) adjoint 
representation with C = 8. With periodic boundary 
conditions (PBC), the 5- vector and the 10- fold states be- 
have similarly as before. However, a marked difference 
is that a new 5*^(4) singlet state appears as the LES at 
50° < 9 < 90°, which becomes higher than the 5- vector 
states only very close to 45°. In particular, it is nearly de- 
generate with the ground state (which is the lowest <S'p(4) 
singlet) at 6* = 50° ~ 60°. In the regime of 0° < 6* < 45°, 
i.e., J2 > Jo the excited states are many Sp{A) multiplets 
with energies close to each other. With OBC, the LESs 
form the lOd Sp{A) adjoint representation. For the PBC 
case, the 14-dimensional symmetric tensor representation 
of Sp(4) competes with the lOd adjoint one. 

The appearance of two nearly degenerate Sp{4:) sin- 
glets at 50° < 9 < 90° with PBC and their disap- 
pearance with OBC can be understood by the dimeriza- 
tion instability. The dimerization and the spin gapped 
ground state was shown in the bosonization analysis at 
45° < 9 < 90°^^. In the thermodynamic limit, the 
ground state has double degeneracy corresponding to two 
different dimer configurations, both spontaneously break- 
ing translational symmetry. The OBC favors only one 
of the dimer configurations, but disfavors the other due 
to one bond breaking. In the finite system with PBC, 
the two dimer configurations tunnel between each other, 
which gives rise to two nearly degenerate S'p(4) singlet 
states. We further calculate the gap between them, de- 
noted by Ass, aX 9 > 45° by using exact diagonalization 
under PBC up to 16 sites. 

As presented in Fig. |3l Ass disappears in the finite 
size scaling due to the twofold degeneracy. On the other 
hand, the existence of the spin gap in this parameter 
regime is presented in Fig. lUby DMRG simulation in Sec. 
nil Bl below. The original Lieb-Schultz-Mattis theorem**^ 
was proved that for the SU (2) case, the GS of half-integer 
spin chains with translational and rotational symmetries 
is gapless, or gapped with breaking translational symme- 



try. It is interesting to observe that our results of the 
S'p(4) spin chain also agree with this theorem. The na- 
ture of the GS in the parameter regime 0° < 6* < 45° will 
be discussed in Sec. IIIIBI 



B. DMRG simulations on 5'p(4) spin chain 
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FIG. 4: The finite size scaling of the spin gap Asp of the 
Sp(4) spin chain vs 1/N at various values of 0. 6 is defined 
a.s 9 = tan~^(Jo/J2) and A'^ is the system size. 

In this subsection, we present the DMRG calculations 
on the ground state properties of the Sp(A) chain up to 
80 sites with OBC. We first present the spin gap A^p in 
Fig. 21 which is defined as the energy difference between 
the ground state and the lowest Sp{4) multiplet. 

For chains with even number of sites, the GS is ob- 
tained with quantum number L\°^ — L23' — 0; ^ind any 
S'p(4) multiplet contains the states with quantum num- 
bers {L\f = ±l,i|^* = 0) and {L\f = 0,^f = ±1). 
States with the same values of {L\°^,L*23) belong 
to different 5^(4) representations, which can be distin- 
guished by their S'p(4) Casimir. Practically, we only 
need to calculate these sectors with low integer values 
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of (-^15*, ^23*) to determine the spin gaps. For the cases 
oi 9 > 45°, i.e., (J2/J0 < l)j ^spS saturate to nonzero 
values as — ^ 0, indicating the opening of spin gaps. 
On the other hand. Asp's vanish at 6* < 45°, which shows 
that the ground state is gapless. These resuhs agree 
with the bosonization analysia^i, which shows that the 
phase boundary is at = 45° with the SU{4:)a symme- 
try, which is also gapless. This gapless SU (4)^ line was 
also studied before in Ref. |43||44| . 
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FIG. 5: The NN correlation of {Li5(i)Li5(i + 1)) with open 
boundary conditions for (a) 9 = 60° and (b) 9 — 30°, respec- 
tively. The dimer ordering is long-ranged in (a). Note the 
2-site periodicity in (a) and the 4-site periodicity in (b). 



To further explore the ground state profile, we calcu- 
late the nearest neighbor (NN) correlation functions of 
the 5^(4) generators for a chain of 80 sites. This cor- 
relation function is similar to the bonding strength and 
defined as {X{i)X{i + l)), where X are 5^(4) generators. 
We present the result of (Li5(z)Li5(z -I- 1)) in Fig. [51 and 
the correlation functions of other generators should be 
the same due to the S'p(4) symmetry. The open bound- 
ary induces characteristic oscillations. At 9 = 60°, i.e., 
J0/J2 = a/S, (ii5(i)ii5(i -t- 1)) exhibits the dominant 
dimer pattern, which does not show noticeable decay 
from the edge to the middle of the chain. This means that 
the dimerization is long-range-ordered in agreement with 
the bosonization analysis^. In contrast, at 9° — 30°, i.e., 
J2/J0 = VS, (^15(1)^15(1 -I- 1)) exhibits a characteristic 
power-law decay with 4-site periodicity oscillations. The 
4-site periodicity is also observed at other 9^s for 9 < 45°, 
same as ones presented in the bosonization analysis. 

We follow the definition for the dimer order parameter 
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FIG. 6: The finite size scaling for the dimer order parameters 
(a) -Dli5 ^'id (b) Dn^ vs 1/N at various 9's. 



in Ref. glii] as 



N N N N 

Dx - \{X[- - l)X{-)) - {X{-)X{- + 1))|. 



(14) 



As shown previously, Xs are 5'p(4) generators and vectors 
in the 5*^(4) spin chain. Without loss of generality, we 
choose two non-equivalent operators as X — L15 and 
714 for 5*^(4) generators and vectors, respectively. The 
open boundary conditions provide an external field to 
pin down the dimer orders. The finite size scaling of 
the dimer orders of the two middle bonds is presented in 
Fig. m (a) and (b) at various values of 9, respectively. It 
is evident that in the regime of 6* > 45° both of Dl^^ and 
remain finite as \/N — whereas for 9 < 45° the 
dimer order parameters vanish. We conclude that the 
ground state is the dimer phase for J0/J2 > 1 . 

Next we present the two point correlation functions of 
{X{i)X{j)), where X is L15 and 714, in Fig. [7](a) and (b), 
respectively. At 9 > 45°, say, 9 = 60°, both correlation 
functions show exponential decay due to the dimeriza- 
tion. In the spin hquid regime oi 9 < 45°, i.e. J2 > Jo, 
however, all the correlation functions exhibit the power- 
law behavior and the same 2k f oscillations with the 4-site 
period. Their asymptotic behavior can be written as 



{X{io)Xii)) cx 



(15) 



Along the SU{A)a line {9 = 45°), the correlations of 
L15 and 714 are degenerate. The power can be fit- 
ted as K « 1.52, which is in good agreement with the 
value of 1.5 from bosonization analysis and numerical 
studieaiiii^iiiiil. As 9 is away from 45°, the S'C/(4) sym- 
metry is broken. For the correlations of L15, the val- 
ues of K decrease as decreasing 9, which can be fitted as 
K = 1.41, 1.34, 1.30 for 9 = 30°, 15°, 0°, respectively On 
the other hand, for the correlations of n^, the values of k 
can be fitted as k = 1.55,1.65,1.60 for 9 = 30°,15°,0°, 
respectively. We also perform the Fourier transforms of 
the correlations of (i^i5(io)-^i5(«))j S{q), and present the 
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FIG. 7: (a) The two point correlations (ii5(jo)i'i5(*)) st 9 = 
0°,15°, 30°, 45° and 60°. The dot line is plotted by the fitting- 
result using cos{x-K /2)/x^'"'^ . The reference point io{~ 40) 
is the most middle site of the chain (A*' — 80). The inset 
indicates that all S{q) for 6 < 45° have peaks located at 
q = 4l7r/81 ~ 7r/2 whereas tt for S = 60°. (b) (n4(io)n4(i)) 
at e = 0°,15°, 30° and 60° and the fitting uses k = 1.55. 



results in the inset of Fig. [7] (a). S[q) is defined as 



(16) 



and q — rmi/{N + 1), where m — 1, 2 • • • ,N are inte- 
gers for OBC. Clearly, in the regime of 6* < 45° all the 
peaks are located at g = 4l7r/81 ^ 7r/2, indicating a 2kf 
charge density wave. On the other hand, S{q) ai 6 = 60° 
appears a peak at tt, which denotes a 4fc/ charge density 
wave and is characteristic of the dimerization phase. 



IV. THE Sp(4) MAGNETISM IN 2D SQUARE 
LATTICE WITH SMALL SIZES 

The quantum magnetism of Eq. [7] in 2D is a very 
challenging problem. Up to now, a systematic study is 
still void. In the special case of the SU{4)b line, i.e. 
J2 = 0, in the square lattice, quantum Monte- Carlo simu- 
lations are free of the sign problem, which shows the long- 
range-Neel ordering but with very small Neel moments 
n4 = {-yLi5 = {-yL23 « O.OSia. This resuh agrees 




FIG. 8: Speculated phase diagram of the 2D Sp{4:) spin-3/2 
systems at quarter filling from Ref. 4]. 6 = tan~^(Jo/J2). 
The SU{4:)a type drawn by the dot fine is at Jo = J2 (0 = 45°) 
whereas SU{4:)b at J2 = (61 = 90°). Bold letters A, B, and 
C represent the plaquette, columnar dimerized and Neel order 
states, respectively. 



with the previous large- iV analysis^*. The Goldstone 
manifold is CP(3) = f7(4)/[J7(l) (g) C/(3)] with 6 branches 
of spin-waves. On the other hand, on the SU{A)a hne 
with Jq — J2, an exact diagonalization study on the 4x4 
sites shows the evidence of the four-site SU (4) singlet pla- 
quette ordering'^^. Large size simulations are too difficult 
to confirm this result. On the other hand, a variational 
wavefunction method based on the Majorana represen- 
tation of spin operators suggests a spin-liquid state at 
the SU{A)a hnei§. Recently, Chen et alX constructed 
an SU{4) Majumdar- Ghosh model in a two-leg spin-3/2 
ladder whose ground state is solvable exhibiting this pla- 
quette state. An SU (4) resonant plaquette model in 3D 
have also been constructed^!^. 

Based on these available knowledge, a speculated phase 
diagram was provided in Ref. Q as shown in Fig. [S] The 
Neel order state C is expected to extend to a region with 
finite J2 instead of only along the J2 = line. Fur- 
thermore, the plaquette order phase A exists not only 
along the SU{A)a fine but also covers a finite range in- 
cluding = 45°. Between A and C, there exists an in- 
termediate phase B which renders ordered dimerizations 
which are two-sites spin singlets. However, these features 
have not been tested due to the lack of controllable an- 
alytic and numeric methods for 2D strongly correlation 
systems. For example, quantum Monte Carlo methods 
suffer notorious sign problems at J2 7^ 0. 

In this section, we begin with the cluster of 2 x 2 whose 
ground states can be solved analytically. Then we per- 
form exact diagonalization (ED) methods for the case 
of 4 X 4 sites and analyze the associated GS profiles for 
different values of 0. Even though the size that we are 
studying is still small to draw any conclusion for the ther- 
modynamic limit, it provides valuable information on the 
ground state properties. 
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(a) The GS wavefunctions of the 2x2 cluster at 
. a and b are coefficients depending on 6 and the 
thick bonds denote the two-site 5^(4) spin singlet states, (b) 
The position indices before and after the permutation P234i. 



wavefunctions remain even under such a rotation P2341, 
whose wavefunctions can be represented as 



\^)^a{\H) + \V))+b\C), 



(21) 



where a and b are coefScients depending on the values of 
9. In fact, the overlaps between GS wavefunctions Eq. 
[21] and the S'/7(4) singlet state |^'s;7(4)) are larger than 
0.98 at < 54°. At 6 > 54°, a level crossing occurs and 
the GS wavefunction changes to 



I* 



5(7(4)/ 



4(1 



H) 



(22) 



which is independent of 9 and odd odd under the rotation 

^2341- 

Combining the above observations, we identify that 
there are two competing states in the system. The 
boundary is located a.t 9 = 54°. Next we turn to an- 
alyze large size systems. 



We begin with the 2x2 cluster, whose ground states 
can be solved analytically for all the values of 9. Such 
a system contains three 5*^(4) singlets, and the ground 
states can be expanded in this singlet subspace. These 
5^(4) singlets can be conveniently represented in terms 
of the dimer states with the horizontal, vertical, and cross 
diagonal configurations depicted in Fig. [9] (a) as 

\H) = ^R^pi,liA)^l{l)R^s^\i2)4{3m, 
\V) = ^R^0,piil)^l{2)R^s^\i3)4{Am, 

\c) = ^R^pi,iii)^imys^UM(^m^ (17) 

where R is the charge conjugation matrix define in Eq. 
im These states are linearly independent but are not 
orthogonal to each other, satisfying {H\V) = {V\C) = 
{C\H) — — i. Under the permutation of the four sites 
P(234i), or a rotation at 90° as shown in Fig. HKb), they 
transform as 

P2:iii\H) = \V), P234i\V) = \H), P2341IC) = |C). (18) 

At 9 = 45°, i.e., the SU{4:)a case, the ground state 
(GS) is exactly an 5[/(4) singlet over the sites 1 to 4iii^ 

\nuii)) ^^ Y. ^P-«^L<2<3'^l4if^), (19) 

where the indices /x,i^,r,^ run over ±|, ±i; jfi) represents 
the vacuum state; Sf^^rS, is a rank-four fully antisymmet- 
ric tensor. It can also be represented as the linear com- 
bination of the dimer states as 

\nm,))^\l\{\H) + \V) + \C)), (20) 

which is even under the rotation operation ^2341- We 
find that in the entire range of < 6* < 54°, the GS 



B. The Low energy spectra for the 4x4 cluster 

In this subsection we study a larger system size of 
iV = 4 X 4. Both L\f = Y.^ Li5{i) and L^f = i23(») 
are good quantum numbers, which can used to reduce the 
Hilbert space. The dimension of the Hilbert space in the 
{L\f,L*2f) = (0. 0) sector goes up to 165 million. On the 
other hand, the lowest multiplet states are located in the 
sector of {L{f,^f) = (0,±1) or (±1,0) and the corre- 
sponding dimension is about 147 million. The dimensions 
of the subspace are too large to perform diagonalization. 
Nevertheless, by using translational symmetry, the di- 
mension of the Hilbert space reduces to 10 million such 
that ED calculations become doable. The ground states 
are always in the sector of total momentum K = (0, 0), 
and are Sp{A) singlets. In the following, except for the 
specific mention in Sec. I IV El the systems are considered 
under periodic boundary conditions. 

The low-lying energy spectra for the = 4 x 4 clus- 
ters for < 61 < 90° are displayed in Fig. Uni The 
ground states for all the values of 9 are Sp{A) singlets 
with Casimir C = 0, and that at 6^ = 45° is an S'C/(4) 
singlet. The lowest excited states are also Sp{4:) singlet 
states at 9 < 63°. The lowest spin multiplets appear 
as the 14-fold degenerate S'p(4) symmetric tensor states 
with C = 10. A level crossing of the lowest excited states 
appears around 9 = 63° implying that there exists com- 
peting phases nearby. At 6* > 63°, the lowest excited 
states become 5-fold degenerate Sp{A) vector states with 
the Casimir C = 4. Another 10-fold degenerate states, 
which form the S'p(4) adjoint representation with C — 10, 
appear as the next lowest excited states. At the SU{A)b 
line, i.e., 9 = 90°, these two sectors merge into the 15- 
fold degenerate states forming the adjoint representation 
of the SU {A) gro up whose SU[A) Casimir is C = 8. 

In Sec. nil Al the appearance of the 5^(4) singlet as 
the lowest excited states in the small size systems im- 
plies the dimerization in the thermodynamic limit. This 
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FIG. 10: (a) The low-lying states for the 4x4 cluster at var- 
ious values of 9. The dimensions of the corresponding 5*^(4) 
representations d are marked. The GS wavefunctions are al- 
ways 5^(4) singlets, (b) The zooming-in around 9 ~ 63° 
exhibiting various energy level crossings. 



is confirmed in the large size DMRG results in Sec. IIIIBI 
Similarly, in the case of the 4x4 cluster, the lowest 
excited states are also 5*^(4) singlet a.t 9 < 63°. This 
also suggests the spin disordered ground state with bro- 
ken translational symmetry in the thermodynamic limit. 
Moreover, the gap between the GS and lowest singlet 
excited state is very small in a narrow regime (roughly 
50° ^ 60°), which implies that an intermediate phase 
may exist exhibiting a different translational symmetry 
breaking pattern from that with small values of 9. How- 
ever, unlike the ID case where we can justify the dimer- 
ization through finite-size scaling of the vanishing of the 
5p(4) singlet-singlet gap, it is impossible in 2D to detect 
the presence of the dimer states or plaquette states from 
the exact diagonalization results. Thus we will resort 
to other approaches to investigate the GS profile in the 
following sections. 




FIG. 11: The energy dispersion E{K) — Eq v.s. for the 4x4 
cluster, r, M, X are the high symmetry points for the many- 
body ground state momenta, corresponding to K = (0,0), 
(tt, tt) and (tt, 0) respectively, in the first Brillouin zone. 

To further clarify, in Fig. [TT] we present the spec- 
tra of lowest energy states at each crystal momentum of 



F = (0,0), X = (77,0), and M = (7r,7r), respectively. At 
9 < 63°, the states at the X-point are lower than those 
at M-point, which are 5*^(4) singlets with the Casimir 
C = 0. These lowest singlet excitations along (tt, 0) or 
(0, tt) would allow the GS to shift a lattice constant along 
X or y-direction, if the gap between these singlets vanishes 
in the thermodynamic limit. It would implies a four-fold 
degeneracy in the thermodynamic limit breaking trans- 
lational symmetry. 

In comparison, a.s 9 > 72°, the energy of states at 
the Af -point are lower than those at the X-point, which 
are spin multiplet with 10-fold degeneracy and the <S'p(4) 
Casimir C = 6. Actually, these states are not the low- 
est excited states which are 5-fold degenerate located at 
the F-point. Nevertheless, their energy splitting from 
the 10-fold states is very small as shown in Fig. (TU] In 
the thermodynamic limit, inspired by the QMC result of 
the occurrence of the long-range ordering in the iS'J7b(4) 
case, we infer the long-range staggered Neel ordering of 
the Sp{4:) spin operators Lab and a long-range uniform 
ordering of S'p(4) vector operators Ua- Thus we infer a 
phase transition from spin disordered ground state to the 
Neel-like state breaking 5*^(4) symmetry. 

Let us make an analogy with the 2D spin-i J1-J2 
model^i^. In that case, the behavior of the low-lying 
energy levels indicates that the lowest excited states 
with nonzero momentum are triplet while the system 
is a magnetic Neel (J2/J1 ^ 0.4) and coUinear state 
(J2/J1 > 0.6), corresponding to K = (7r,7r) and (7r,0), 
respectively. However, there exists an intermediate phase 
in 0.4 < J2/J1 < 0.6, where the GS is a magnetic dis- 
ordered state and the lowest excited state with nonzero 
momentum, K = (tt, 0), is singlet. In this region it has 
been conjectured that the GS is a dimerization state or 
a spin-liquid (resonated- valence-bond state). Similarly, 
the low-lying energy behavior in our model implies that 
the GS is non- magnetic at 6* < 63°. On the other hand, 
at 6' > 63°, the GS has spinful excitations and is relevant 
to the Neel state. 



C. The magnetic structure form factor 

In this subsection, we present the results of the mag- 
netic structure form factors for the iV = 4 x 4 cluster. 
Two different structure form factors ^'^(g) and Sniq) are 
defined for the Sp{4:) generator and vector channels, re- 
spectively, as 



Sniq) 



1 V 

^ ij,l<a<b<5 



,iq-{ri~rj) 



{G\Lab{i)Lab{j)\G), 



1 V 

2,_;,a— 1~5 



,iq-{ri-rj) 



(G|n,(i)n,(i)|G), (23) 



where the normalization constants gL = 10 and Qn = 5. 
SL{q) and Sn{q) are the analogy of the Fourier transfor- 
mation of {G\Si ■ Sj\G) in SU{2) systems. If the long- 
range magnetic order appears, the magnetic structure 
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FIG. 12: The magnetic structure factors for the 4x4 cluster, 
(a) The structure factors SL{q) for the Sp{4:) generator sector 
The inset is the comparison between 5'L(7i",0) and 5'L(7r,7r) 
versus 6. (b) The 5*^(4) vector structure factor Sn{q). 



lOd tensor representation with C = 6 in the Sp{A) sym- 
metry, respectively. The contributions to Sn^Kr) and 
Sl{Km) mainly come from the matrix elements between 
the ground state and the 5d vector states, and lOd anti- 
symmetric tensor states, respectively. On the other hand, 
in the case of SU{4)a with 9 = 45°, Sn{q) = Sniq) for 
each q. 

These features highlight that the dominant Neel cor- 
relation of the Sp{4) generators La&'s not only exhibits 
along the SU{4:)b line but also extends to a finite regime 
with non-zero values of J2. In the same parameter 
regime, the 5^(4) vectors n^s exhibit dominant uniform 
correlations. The critical value of 9 of the onset of the 
outstanding 5'i(7r,7r) is in good agreement with the lo- 
cation of the level crossing shown in Fig. [TUl implying a 
transition of the GS from a non-Neel state to a Neel type. 
The inset in Fig. [12] (a) compares the SL{q) behavior at 
q — (7r,0) and (7r,7r) versus 9. S'L(7r, 0) changes little 
as varying 6. Therefore, it is inferred that only the Neel- 
type order exists at 9 close to 90°. The magnetic ordering 
at (tt, 0) should not appear in the 2D Sp{A) system. 

Next one may raise a natural question: what is the 
spin pattern for the Neel-order state as — t- 90° ? Ac- 
cording to Eq. 1121 its classic energy can be minimized by 
choosing a staggered configuration for {G\Li5{i)\G) — 
{G\L23{i)\G) = (— and a uniform configuration of 
{G\ni{i)\G) — ±i. These correspond to the staggered 
arrangement in the 2D lattice by using the two compo- 
nents of = ±|, or by using the other two components 
of i^z = ±i. These different classic Neel states can be 
connected by an Sp{4) rotation. 



D. The columnar dimer correlations 



factor converges to a finite value in the thermodynamic 
hmit^!^. 

The ED results of SL{q) for the 4x4 cluster are pre- 
sented in Fig. [H (a). As 61 < 60°, S'i(g) distributes 
smoothly over all the momenta, and its maximum is lo- 
cated at q — (tt, which is slightly larger than other 
values of q. In contrast, when 60° < 9 < 90°, SL{q) peaks 
at Km = (tt, tt). The 5*^(4) vector channel structure fac- 
tor Sn{q) is depicted in Fig. [12] (b). At small values of 0, 
it peaks at the M-point exhibiting a dominate correlation 
at the momentum (tt, tt). As 6* > 60°, the peak changes 
to the r point and the Af -point becomes a minimum. 

Along the 51/(4)5 line with 61 = 90°, 5„(q) = SLiq + 
Km) due to the staggered definition of 5*^(4) vectors Ua 
in Eq. [T^] This relation between Sn{q) and SL{q + Km) 
is consistent with the previous observation on the low- 
energy spectra in Fig. [10] As 9 > 60° there are two 
nearly degenerate excited states beyond the GS, having 
the total momentum of (0,0) and (7r,7r). They corre- 
spond to the 5d vector representation with C = 4 and the 
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FIG. 13: The susceptibilities defined in Eq. [24] with respect 
to the perturbations Odim and Orot for the A'^ = 4 x 4 cluster, 
(a) XdimiQ) versus 61 at Q = (7r,0); (b) Xrot versus 9; (c) 
XdimiQ) versus 6 a.t Q = {iT,n). In both cases, a small value 
of S — 0.01 is taken to evaluate the susceptibilities. Both 
susceptibihties exhibit peaks around 6 ~ 60° ~ 70°. 

In this subsection, we discuss the possibility of the 
dimer-ordered state at intermediate values of 6. We de- 
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fine the susceptibility to a symmetry breaking perturba- 
tion as 



X{5) 



2[eW-e(0)] 
52 



(24) 



where e(0) is the GS energy per site given by the Hamil- 
tonian Eq. ([7|) and e{S) is Eq. [7] plus the corre- 
sponding perturbation term —SO^'^'^^. In the presence 
of long-range ordering, the corresponding susceptibility 
X = lims^o x{S) will diverge in the thermodynamic limit. 
It has been demonstrated that this approach can effi- 
ciently distinguish dimerized and non-dimerized phases 
in the ID J1-J2 spin-i chain^, in which the phase bound- 
ary J2/J1 « 0.24 between these two phases. 

Here we employ the same method to study the dimer- 
ization correlations. Although with small size calcula- 
tions, we are unable to determine the existence of long 
range order, it is still instructive to observe the feature 
of X- We have used it to test the ID 5*^(4) system with 
the perturbation term of O = ^ ■(— l)'iJex(«, i -I- 1). At 
9 = 60°, we found the dramatic growing behavior of x((5) 
upon decreasing S and increasing the system size, which 
leads to a divergent x in the thermodynamic limit. On 
the other hand, xi^) at = 30° has no tendency of di- 
vergence over decreasing 6. This observation is consistent 
with our previous analytical and numerical studies: the 
ID Sp{4:) system is either a gapless uniform liquid as 
9 < 45° or a gapped dimerized state with the breaking 
of translation symmetry at 9 > 45°. 

Next we apply this method to the 2D system with the 
size of 4 X 4, and define two susceptibilities Xdim{Q) and 
Xrot for two perturbations of OdimiQ) and Orot as 

OdimiQ) = ^cos{Q ■ ri)Hex{i,i + x), (25) 

i 

Orot = Y^[Hex{i,i + x)~ H^x{i,i + y)], (26) 

i 

where Hexiiij) is defined as one bond of the Hamilto- 
nian Eq. [7] without summation over i and j. Let us 
set Q — (7r,0), thus x<iim(7r, 0) corresponds to the in- 
stability to the columnar dimer configuration. Eq. [55] 
and Eq. [221 break the translational symmetry along the 
x-direction and rotational symmetry, respectively. The 
plaquette ordering maintains the 4-fold rotational sym- 
metry, thus will lead to the divergence of XdimiT^, 0) but 
not Xrot- The ED results for the susceptibilities with 
respect to the two perturbations versus 9 in Fig. [T3| 
(a) and (b), respectively. A small value oi 5 — 0.01 is 
taken. Both susceptibilities exhibit a peak at 9 from 60° 
to 70°, which implies a tendency to breaking both trans- 
lational and rotational symmetries. This shows that the 
columnar dimerization instead of the plaquette ordering 
is a promising instability in this regime in the thermody- 
namic limit. We have also calculated the susceptibility 
of XdimiQ) for Q = (tt, 71") which corresponds to the in- 
stability to the staggered dimer configuration in Fig. [T3| 



(c). Although the magnitudes of Xdimij^TT^) are smaller 
than Xdim(7r, 0) and Xrot, it suddenly raises up around 
9 = 60°. 



E. The plaquette form factor 







— ■ — 


A 







— — 


B 


3 




— A— 


C 



\ 

oooo-o- c 



30" 



60° 



90° 



e 



FIG. 14: C{r) defined in Eq. [23 versus 6. The positions of 
plaquette A, B and C axe defined on the right schematics. A 
(blue) is located at the corner whereas C (black) in the most 
middle one. 

In this subsection, we consider the plaquette type cor- 
relation. The ground states of the 4x4 cluster aX 9 < 60° 
signal a different class from that in > 63° in which the 
lowest excited states are spin multiplet with K = (7r,7r). 
Here, the lowest excited states remain 5*^(4) singlets with 
K — (tt, 0) or (0,7r). To further elucidate the ground 
state profile, we define the local Casimir for the plaque- 
tte centered at r, 



(27) 



l<a<b<5 



where i runs over the four sites of this plaquette. The 
SU{2) version of Eq. \T7\ has been used to classify com- 
peting dimer and plaquette orders^. If the GS exhibits a 
strong plaquette pattern, for instance, indicated as phase 
A in Fig. [51 the magnitudes of C(r) will have obvious 
spatial variations between nearest-neighboring plaquette. 
This is analogous to the ID dimerization picture in Fig. [5l 
(a), where the nearest-neighboring spin-spin correlations 
exhibit strong and weak alternately in magnitude. When 
the spins around a plaquette are strongly bound to form 
an SU{4) singlet, C(r) should be close to zero. 

Fig. [TH depicts the behavior of C(r) at various values 
of 9 for the 4x4 cluster. In order to explicitly refiect the 
plaquette formation, we use open boundary conditions 
rather than periodic boundary conditions. In this case 
only Civ point group symmetry is applicable in the ED. 
The C{r) for the corner plaquette A is much smaller than 
i of those at the center C and the middle of the edge B 
for small values of 9. This is in sharp contrast to the 
2D spin-1/2 model which renders C{A) = 0.545, C{B) = 
1.015 and C(C) = 1.282, which only show the difference 
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at order of 1. The comparison suggests the pinning-down 
plaquette state in the 2D Sp{A) system under the open 
boundary. We observe that C{A) and C{B) decrease 
while 6 goes beyond 60°. It accounts for the formation 
of the plaquette-type pattern weakens or even vanishes. 

Combined the above observations, it is hkely that for 
< 60° the GS has a strong plaquette-hke correlation, 
that could be the resonate plaquette state proposed by 
Bossche et alM- or a certain spin-liquid. It does survive 
not only along the SU{A)a line but also in a finite regime. 
Nevertheless, we have to emphasize that this picture can- 
not be conclusively determined due to finite size effects 
and further larger size calculations are needed to confirm. 



V. CONCLUSION 

In conclusion, we study an Sp{A) / SO{?)) spin Heisen- 
berg model which can be realized by the large spin ultra- 
cold fermions with F = |. The 5^(4) Heisenberg model 
describing the magnetic exchange at the insulating state 
of quarter-filling is simulated by exact diagonalization 
and DMRG. In ID, our numerical results are in agree- 
ment with previous analytic studies. There are two com- 
peting phases: a gapped dimer phase with spin gap at 
9 > 45° and a gapless spin hquid a.t 9 < 45°. The 
phase boundary is identified as 6* = 45° which belongs to 
S'?7(4)^-type symmetry. In the gapless spin liquid phase, 
the static correlation functions decay algebraically with 
four-site periodicity oscillations. 

We also investigate the Sp{4) spin model on a 2D 
square lattice up to 16 sites by means of exact diago- 
nalization methods. Our numerical results show three 
competing correlations: Neel-type, plaquette formation 
and columnar spin-Peierls dimerization, depending on 
0's. Such observation can have phase behavior analogy in 
comparison with the speculated phase diagram depicted 
in Fig. \8\ Due to the finite size effects, however, we 
are unable to conclusively identify the existence of these 
phases and the phase boundaries based on the small clus- 
ter. More numerical studies are necessary to further ex- 
plore the phase diagram in the thermodynamic limit. 
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Appendix A: Representation theory of the simple 
Lie groups and algebras 

The representation theory of Lie groups and algebras 
can be found in standard group theory textbooks^. Here 
we give a brief pedagogical introduction. Among the 
group generators, we choose the maximal set of gener- 
ators that commute with each other as the Cartan sub- 
algebra {Hi, (i — 1, ...fc)}, where fc is called the rank of the 
Lie algebra. For example, the SU{2) algebra is rank one, 
whose Cartan sub-algebra only contains Sz- AH other 
generators can be organized as eigen-operators of each 
generator in the Cartan sub-algebra, which are called 
roots. Roots always appear in terms of Hermitian con- 
jugate pairs as Ej± with the relation Ej^ — Ej_^_. They 
satisfy the commutation relations of 

[H,,E±,] = a±,{t) E±„ (Al) 

with dj = —d-j, where the z-th elements of the vectors 
d±j are the eigenvalue of E±j with respect to Hi. For 
example, for the simplest SU{2) case, the roots are S± = 
Sx ± iSy and [Sz,S±] = ±S±, where a± only have one 
component with a± = ±1. 

Among all the roots, we fix the convention to use E^j 
for positive roots, which means the first non-zero com- 
ponents of their a+j are positive. Positive roots can be 
decomposed into the linear combinations of .simple roots 
with non-negative integer coefficients. The number of 
simple roots of a simple Lie algebra equals to its rank. 
The Cartan matrix A of a, simple Lie algebra is defined 
as 

Aj^2^^^, (z,j = l,...,fc), (A2) 

where di is the vector of eigenvalues of the simple root 
Ei] the inner products of a- vectors is defined as 

fc 

(d^dj) = ^a,(Oaj(Z). (A3) 

1=1 

The dimension of the Cartan matrix is the same as the 
Cartan sub-algebra. For the SU (2) group, the only pos- 
itive and simple root is S-^- , and the 1x1 Cartan matrix 
A ^2. 

An important concept of the representations of the 
simple Lie algebra is weight. For a rank-A; simple Lie 
algebra, its fundamental weights can be solved through 
its k X k Cartan matrix 

(i = l,...,fc). (A4) 

j 

Any irreducible representation of a simple Lie algebra is 
uniquely determined by its highest weight M* , which can 
be written as a linear combination of the fundamental 
weights Mi 

M* =^p,M,,{i^l,...,k), (A5) 

i 
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where fi's are non-negative integers. The dimension of 
the representation M* is 



d{M* 



n 

positive roots 



(A6) 



with 



R = 



positive roots 



Please notice that the product in Eq. IA6l and summation 
in Eq. IA7I take over all the positive roots. The value of 
the Casimir operator for the representation denoted by 
M* is 



C{M*) = {M*,M* + 2R). 



(A8) 



For the simplest example of SU{2), the only fundamen- 
tal weight M = i. The highest weights is just M* = 5, 
where 5* takes half-integer and integer numbers. Obvi- 
ously, d{S) = 25* -f 1 and C{S) = S{S + 1) as expected. 



Appendix B: The Sp{'i){SO{5)) algebra 

For convenience, we use the following symbols to rep- 
resent the Sp{4:){SO{5)) generators Lah(l < a < 6 < 5) 
defined in Eq. [5] as 



Lab 



1 ReTTx ReTTy RbtTz Q \ 





V 



Sy Im-TTx 
—Sx ImTTy 

ImTTz 

) 



(Bl) 



where 



rt - 



RCTTx — ilmTTx = '0-3''/'^ + 

~2~ 2 2 2 

ReTTy -I- ilmTTy = — iC'f/'tV'-S — V'lV'-i), 

2 2 2 2 

RcTTy — ilmTTy = i(-i/'L3'03 — V'llV'i): 

— 2 2 2 

ReTTz + ilniTTz — t/" t i — ^1 V'- 1 , 

2 2 2 2 

ReTTj. — ilniTTz — ■0^1 V'l — V'^^aV'ii 

2 2 2 2 

= 5'a; + iSy = ^/'tV'i - V'll V'-^: 
2 2 2 2 

2 2 2 2 

2^ 2^ 2^ 



(B2) 





Roots 


Q±l — — ij 




= -^{tV:, + i-Ky) 


a±2 = ±(0, 1) 


£2 = -^(S-^+iSj 


E-2 ^ ^{S^ ~ iSy) 


Q±3 =±(1,1) 






Q±4 = ±(1,0) 


^4 - 


^-4 = 



(A7) [£4, £-4] 



TABLE I: Cartan sub-algebra and its roots. [Ei,E-i] = 
i(Q - 5.), [E2,E.2] = i^., [E3,E^s] = i(Q ± S.), 



[£2, -E-2] 





(Mi,At2) 


M* 


d(M*) 


C(M*) 


1 


(0,0) 


(0,0) 


1 





2 


(0,1) 


(i i) 

V 2 ' 2 


4 


5 
2 


3 


(1,0) 


(1,0) 


5 


4 


4 


(0,2) 


(1,1) 


10 


6 


5 


(2,0) 


(2,0) 


14 


10 


6 


(1,1) 


(3 l^ 


16 


15 
2 


7 


(1,2) 


(2,1) 


35 


12 


8 


(0,3) 


(3 3n 
^2' 2-^ 


20 


21 
2 



TABLE II: Some irreducible representations of the 
Sp{4:)/ SO{5) group: the highest weights, dimensions 
and Casimirs. 



The ten operators of Sp{4) satisfy the commutation 
relations 

[Lab, Led] = —i{5bcLad ± SadLbc — ^acLbd — ^bdLac), (B3) 

which is rank-2 Lie algebra. Its Cartan sub-algebra only 
contains two commutable generators Hi{i — 1,2), which 
can be chosen as {Hi = Sz, H2 — Q). We group the other 
8 generators as their eigen-operators, i.e., roots as repre- 
sented E±i, E±2, E±3, E±4, whose eigenvalue vectors d±j 
are presented in Tab. I. The simple roots are Ei with 
di — (1,-1) and and E2 with Q!2 — (0,1). The other 
roots can be represented as E^ = E1+2E2, E4 = Ei+E2- 
The Sp{4:)/SO{5) Cartan matrix reads 



A: 




(B4) 



We solve the fundamental weights as Mi = 
(1,0), M2 = (^,5) from Eq. \M The highest weight 
M* can be written as 



M* 



(toi,TO2) = ipi + 



2 ' 2 ^' 



(B5) 



where /ii^2 are non-negative integers. The dimension of 
the corresponding representation is 



d(Mi,A^2) = (l±/ii)(l±M2)(l + ^^^if^) 
X (1 + ^). 



(B6) 
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The representation {fii,fi2) belongs to the category of 
tensor or spinor representations of 5*^(4) when /i2 is even 
or odd, respectively. The Casimir operator reads 



C{M* 



a<b 



g2 + 52 



mi{mi + 3) + m2(m2 + 1). 



(B7) 



We summarize some frequently used representations of 
Sp{A){S0{5)) in Table II. The representations with in- 
dices 1 to 5 are particularly useful. They are the identity 
(Id), the fundamental spinor (4d), vector (5d), adjoint 
(lOd), symmetric traceless tensor (14d) representations 
of the SO{5) group, respectively. 



Appendix C: 5'(7(4)(SO(6)) algebra 

The SU{4:) group is isomorphic to 5*0(6). Their re- 
lation is similar to that between SU{2) and 5*0(3), or 
5p(4) and 50(5). As represented in Eq. [SJ Lab and the 
five spin-quadrapole operators = i^a^ap^P together 
form the 15 generators of the 5C/(4) group. Explicitly, 
the generators of UaS are written as 

Z 2 2^ 2 ^ 2 ^ 

= -^(V^tV^i - V'Wa - + V'lsV'-i) 

Z 2 ^ 2^ 2 ^ 2^ 

714 = ■^(V'tV'a - i/'i V'l - V'li V'-i + V'LsV'-a) 

Z 2 2^ 2 ^ 2^ 

Z 2 ^ 22 22 22 

(CI) 

The rank of the 5*17(4) group is three. We choose 
((5,5*2,71,4) as Cartan sub-algebra and group the other 
12 generators as roots as shown in Tab. III. 



(Q,S.,n4) 


roots 


Q±i = ±(1,-1,0) 




a±2 = ±(0,1,-1) 




a±3 = ±(0,1,1) 


F3 = :^(S^ + iSy + n2 + ina) = Tf^Wi 


a±4 = ±(1,1,0) 


F4=^(4±^4) = 78^|V'-| 


a±5 = ±(1,0,1) 




Q±6 = ±(1,0,-1) 





TABLE III: Cartan sub-algebra and its roots. [Fi,F_i] — 

i(g - S.),[F2,F_2] = i(S. - 714),[F3,F_,] = i(S. + 
n4),[i^4,f'-4l = \{Q + S.),[Fs,F-5\ = |(Q + 7l4),[i^6,i^-6] = 

i(Q-n4). 



The simple roots are Fi , F2 and F3 with the eigenvalue 
vectors di = (1,-1,0), 02 = (0,1,-1), = (0,1,1), 



respectively. The other positive roots are represented as 
F^ = Fi+F2+ F3, F5 = Fi + F3 and Fq = F^ + F2. The 
5J7(4)/50(6) Cartan matrix reads 



(C2) 




The fundamental weights can be solved by using Eq. IA4I 
as 

All = (l,0,0),Al2 = (^, ^,-^),M3 = ^,^). (C3) 

The highest weight M* of each representation can be 
chosen as 

M* — {7711,7712,1713) — niMi + ^2M2 + fisMs 

, , , M3 [1-2 Us Us. , , 

= (Mi±y + y,y±y,-y + y). (C4) 

The dimension and Casimir of the representation M* are 
represented as 

d{M*) = (l + ^,i)(l+^i)(l±A^i)(l + ^^4^) 

X (l + ^)(l + ^^i±f±^), (C5) 
C{M*) = Hl + Hl + Hl + %Y.{^-^P—) 

A + 

= mi (toi + 4) + 7712(771,2 ± 2) + 77X3. (C6) 



Rep 


(Ml,M2,/i3) 


Af*(7Tll, 7712, 7773) 


d(M*) 


Casimir 


1 


(0,0,0) 


(0,0,0) 


1 





2 


(0,0,1) 


(111) 


4 


15 
4 


3 


(0,1,0) 


(- - —) 

V 2 ' 2 ' 2 / 


4 


15 
4 


4 


(1,0,0) 


(1,0,0) 


6 


5 


5 


(0,0,2) 


(1,1,1) 


10 


9 


6 


(0,2,0) 


(1,1,-1) 


10 


9 


7 


(0,1,1) 


(1,1,0) 


15 


8 


8 


(2,0,0) 


(2,0,0) 


20 


12 



TABLE IV: Some frequently used irreducible representations 
of the 5*0(6) or 5*17(4) group: the highest weight, dimension 
and Casimir. 



We summarize some frequently used representations 
of 5?7(4)(50(6)) in Tab. IV. Representations with in- 
dices from 1 to 6 are the identity (Id), the fundamental 
spinor (4d) and its complex conjugation (4d), the rank-2 
anti-symmetric tensor (6d), the rank-2 symmetric ten- 
sor (lOd) and its complex conjugation (lOd), the adjoint 
(15d) representations, respectively. On the other hand, 
the Young pattern is often convenient for the representa- 
tions of SU{N) group. The Young patterns of the rep- 
resentations from 1 to 8 in Tab. IV are shown in Fig. 
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1:1d 



□ 
2:4d 



3:4d 



B ^ 



4:6d 



5:10d 6:10d 



7;15d 



8:20d 



FIG. 15: The Young patterns of the 5J7(4) representations 1 
to 8 presented in Tab. IV. 
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